Skip to content

PARQUET-1367 upgrade a few libs for security reasons#508

Closed
mattdarwin wants to merge 5 commits into
apache:masterfrom
mattdarwin:master
Closed

PARQUET-1367 upgrade a few libs for security reasons#508
mattdarwin wants to merge 5 commits into
apache:masterfrom
mattdarwin:master

Conversation

@mattdarwin
Copy link
Copy Markdown

@mattdarwin mattdarwin commented Aug 2, 2018

There are a number of libraries which need updating. Among other reasons, there are several security issues filed in CVE for Hadoop and guava

Comment thread parquet-hadoop/pom.xml Outdated
<dependency>
<groupId>org.xerial.snappy</groupId>
<artifactId>snappy-java</artifactId>
<version>1.1.2.6</version>
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

could you please link the CVEs for snappy-java?

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There is no CVE that I found for snappy-java. But here at Oracle the security team won't approve use of software more than 18 months or 5 versions old. snappy-java 1.1.26 is 26 months and 9 releases old. For that reason I included it in the PR. (Same applies for fastutil and slf4j.)

@nandorKollar
Copy link
Copy Markdown
Contributor

Looks like there are compilation failures, probably because of the Guava upgrade. Could you please have a look at it?

@mattdarwin
Copy link
Copy Markdown
Author

Thanks, I've now pushed in the fix.

Copy link
Copy Markdown
Contributor

@nandorKollar nandorKollar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@mattdarwin
Copy link
Copy Markdown
Author

I attempted to upgrade elephant bird (since 4.4 is also quite old), but it appears that from version 4.5 onwards they removed some packages, including com.twitter.elephantbird.thrift.test, so I had to revert it.

@Fokko
Copy link
Copy Markdown
Contributor

Fokko commented Jan 2, 2020

Just rebased. It looks like a lot of the stuff is already on the master branch.

@Fokko
Copy link
Copy Markdown
Contributor

Fokko commented May 5, 2026

Closing this since it is outdated

@Fokko Fokko closed this May 5, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants